Twenty five years after KLS: A celebration of non-equilibrium statistical mechanics 



R. K. P. Zia 

Department of Physics, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061-0435, USA 

(Dated: November 11, 2009) 

When Lenz proposed a simple model for phase transitions in magnetism, he couldn't have imagined 
that the "Ising model" was to become a jewel in field of equilibrium statistical mechanics. Its role 
spans the spectrum, from a good pedagogical example to a universality class in critical phenomena. 
A quarter century ago, Katz, Lebowitz and Spohn found a similar treasure. By introducing a 
seemingly trivial modification to the Ising lattice gas, they took it into the vast realms of non- 
' equilibrium statistical mechanics. An abundant variety of unexpected behavior emerged and caught 

many of us by surprise. We present a brief review of some of the new insights garnered and some 
of the outstanding puzzles, as well as speculate on the model's role in the future of non-equilibrium 
statistical physics. 

00 
(N 



OS 

o 



I. INTRODUCTION 



Over a century ago, Boltzmann and Gibbs laid the foundations for a comprehensive treatment of all systems 
in thermal equilibrium. By contrast, our understanding of non-equilibrium statistical mechanics (NESM) is quite 
primitive. To date, an overarching principle remains elusive, even for time-independent (steady) states. Yet, such 
systems are ubiquitous, encompassing all biological systems, for example. Thus, understanding "physics far from 
equilibrium" is recognized as one of the greatest challenges of current condensed matter and materials physics [Ij, 
with significant implications for technological advances in the sciences and engineering. Faced with such grand vistas, 
one approach is to focus on simple model systems, with the goal of identifying essential characteristics of NESM 
that defy our equilibrium-trained expectations and intuitions. This paper will be devoted to a seminal effort in this 
C$ • direction. 

Twenty five years - and 50 Statistical Mechanics Meetings - ago, Katz, Lebowitz and Spohn (KLS) introduced a 
I , simple modelQ , motivated partly by the physics of fast ionic conductors under the influence of an external DC field [|[ . 
It involves a seemingly trivial modification of the two-dimensional Lenz-Ising model namely, an interacting lattice 
gas with biased hopping along one of the axes. A brief review of this model is the main theme of this article, dedicated 
to the celebration of the 100 th Statistical Mechanics Meeting. We will recount the many surprises it provided, the 
i_i numerous variations it spawned, the aspects that are now understood, the puzzles that remain outstanding, as well 
as some of the general insights on NESM it offered. A more detailed review of the "first dozen years of KLS" can be 
] found in 

The KLS and the Ising models share many noteworthy features. Both represent the barest of essentials for a system 
' with many interacting degrees of freedom to display non-trivial behavior. Each is motivated by physical systems 
and their interesting properties, e.g., phase transitions. In the 20's, the Ising model was "scorned or ignored" [6[ as a 

l/^ ■ simple mathematical toy of theorists. When Lenz proposed the model, Ising was able to solve it only in one dimension 
and the resultant lack of a phase transition must have disappointed theorists at the time. With the contributions of 
many, from OnsagerQ to Wilson and Fisher Q, it became part of well-established text-book material. Not only is it 

^\ \ one of the most celebrated models within and beyond theoretical physics, it has been realized physically in several 
systemsfSfl. Fortunately, the KLS model enjoyed more respect in its first decade than the Ising model did in the 30's. 
Unfortunately, a physical realization has yet to be found. Furthermore, it is so challenging that very little is known 
analytically, even in one dimension. At the "most fundamental" level, its stationary distribution is not known, in 
stark contrast to the explicit exp [(3J^2 ss '} m the Ising model in equilibrium. Consequently, most of its macroscopic 
properties are beyond our analytic abilities and its collective behavior, as discovered through computer simulations, 
continues to confound our intuitive ideas. In the remainder of this article, we briefly look back on these 25 years and 
look forward to much more progress on the KLS model, as well as non-equilibrium statistical mechanics in general. 



II. THE DRIVEN LATTICE GAS AND ITS SURPRISING BEHAVIOR 

The KLS model is based on the Ising lattice gas [H,[l(| with attractive nearest-neighbor (NN) interactions, evolving 
under particle- hole or spin-exchange [llj dynamics. The original study involved square lattices with periodic boundary 
conditions (PBC) 0. Here, let us consider a slightly more general version, with other BC's on a rectangular lattice 
with L x x L y sites (each of which may be occupied by a particle or left vacant). Thus, a configuration is specified 
by the occupation numbers {n x ^ y }, where x,y labels a site and n is either 1 or 0. The intcrparticlc attraction is 
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given by the Ising Hamiltonian: H = — 4JJ^ n x ,yn x ',y', where x,y and x',y' are NN sites and J > 0. With no drive 
and coupled to a thermal bath at temperature T, a half filled system undergoes a second order phase transition at 
the Onsager temperature To = (2.2692..) J/fcs, from a homogeneous, disordered state to an inhomogeneous state 
displaying the coexistence of two regions with high and low particle densities. Minimizing surface energy, each region 
forms a single strip, parallel to the shorter axis. To simulate the lattice gas, a common protocol is to choose a random 
NN particle-hole pair and exchange them with probability min[l, e~ An ^ kBT ], where ATi. is the change in H due to 
the exchange. 

The deceptively simple extension in KLS is to bias the particle hops along, say, the y axis, so that the new rates are 
min[l, e~( AW+£Aj, )/ fcBT ]. Locally, the effect of the "electric" field, E, is identical to that due to gravity. However, due 
to the PBC, this modification cannot be accommodated by a (single-valued) Hamiltonian. Instead, the system settles 
into a non- equilibrium stationary state with a non- vanishing global particle current. At first sight, this KLS model 
appears quite similar to the Ising case: For T larger than a critical T c , a half filled system remains in a homogeneous 
state, while below T c , the system displays phase segregation. With deeper probing, dramatic differences surface at 
all temperatures. Moreover, many properties are entirely counterintuitive. Before discussing these surprises, let us 
point out that the usual Ising symmetry (particle<^hole, in the lattice gas language) is violated by the drive, though 
the combined operation of particle O- hole © y — y (known as CP) is still valid. A closely related model to KLS is 
the randomly driven lattice gas (RDLG), in which the sign of E is chosen randomly, say, for every hop attempt 
The effect is similar to a two-temperature Ising lattice gas (TTLG) [13], in which hops along y are coupled to another 
thermal bath at temperature T' and updated with min[l, e ~^ n / k BT j_ p or gj^her f these, the full Ising symmetry 
is clearly restored. But neither will be comparable to the equilibrium Ising model and Boltzmann factors will not 
describe the stationary distributions of any of the driven systems. 

Returning to KLS, the first surprise is how T c varies as E is increased. For "infinite" E, hops aligned with the 
y axis are accepted or rejected regardless of AH. Thus, the drive tends to break bonds, impair correlations, and 
increase disorder - an effect similar to being coupled to an "infinite" temperature bath. Such considerations would 
lead naturally to the prediction that the internal energy (average number of broken bonds) of the system should 
increase with E, so that T c would decrease. Simulations [2| showed quite the opposite: T c increases, saturating at 
~ lATo for E — oo! Remarkably, this same shift in T c is also observed in both the RDLG and the TTLG. Especially 
in the TTLG, it is natural to regard our system as coupled to two baths (with T" > T). In this sense, we can rephrase 
the "first surprise" as negative response: The internal energy of our system decreases even though T' is increased. 
This kind of "surprising" behavior and its origins are now reasonably well understood[l4j . so that arguments can be 
advanced to predict the class of drives that would lead to increasing/decreasing T c 's. The general lesson here is that 
negative responses can be easily induced in NESM systems. 

The next surprise for the early investigators is that, for all T > T c (where the system is homogeneous), there 
are long range correlations - despite the interactions and the dynamics being both short ranged. The origin of the 
difference between this behavior and that in the equilibrium Ising model can be traced to the violation of detailed 
balance and the fluctuation dissipation relation (FDR). For a system in d dimensions with a conserved density, the 
autocorrelation function is known to decay as t~ d / 2 . Given the diffusive nature for a non-critical system, the scaling 
r ~ t^ 1 / 2 should hold and so, we should expect the equal-time correlation to decay as r -d [l5j]. The amplitude of 
this power turns out to be anisotropic - positive along the direction of the drive and negative otherwise, mimicking 
a dipolar interaction. In Fourier space, this amplitude transforms into a discontinuity singularity [l|| of the structure 

factor S (jzj at k = 0, e.g., 1Z = S (k x — > 0, k y — 0) — S (k x — 0, k y — > 0) > in d = 2. This behavior is "generic," in 

that 1Z is tied to the violation of the FDR. In this sense, systems in equilibrium are "singular," since FDR forces 1Z to 
vanish, so that the correlation in the Ising lattice gas decays as e~ r ^ rather than r~ d . To understand these features, 
it is straightforward to following the spirit of Landau-Ginzburg for the Ising model and formulate a theory for the 
coarse grained particle density, p(x, t). Defining ip = 2p — 1, taking into account all anisotropies, and anticipating 
relevant interactions for T < T c , we write the full Langevin equation 

dt<p(x,t) = \{(T ± -Vl)V 2 L tp+(T ll -a ll d 2 )d 2 (p-2a x d 2 V 2 L (p + 

+u(Vl + Kd 2 )p 3 +£d<p 2 }-Z{x,t) , (1) 

with noise correlations 

(a*,t)a*',t')) = -(a 1 _Vl + o' ll d 2 )5(x-x')5(t-t') . (2) 

For the d = 2 case, and d reduce to d x and d y , respectively. This approach can account for all the novel properties 
phenomenologically, for example, with 1Z oc a±/r± — <^\\/t\\ UM- 

As T is lowered towards T c , simulations first revealed the onset of phase separation, but only transverse to the drive, 
corresponding to a diverging 7Z but with S (k x = 0, k y — > 0) remaining finite. As a result, k y does not scale naively 
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FIG. 1: Typical configurations in a 100 x 100 system, driven at E = 50 J, with T = 0.8Tb: (a) SPBC imposed with shift 5 and 
(b) shift 20. 




FIG. 2: A typical configuration in a 72 x 36 system with SPBC and shift 6, driven at E = 50 J, with T = 0.8Tb. To provide a 
global perspective, the original (framed in a red rectangle) is reproduced multiple times in accordance with the SPBC. 



with the transverse momenta, so that analyses using techniques for "strong anisotropic scaling" are unavoidable [17 1. 
Based on these observations and starting with the Langevin equation above, a field theoretic renormalization group 
analysis can be set up[l8j and, unlike the Ising universality class [l9j. the upper critical dimension is d c = 5. More 
significantly, the fixed point cannot be written in terms of a "Hamiltonian" and is genuinely "non-equilibrium" in the 
sense that it contains a term corresponding to a non-trivial (probability) current [20(. By contrast, a similar treatment 
for the RDLG leads to a fixed point Hamiltonian^^ , so that its leading singularities fall into the universality class of 
a system in equilibrium. Returning to the KLS case, a hidden symmetry associated with the fixed point is identified, 
so that critical exponents can be calculated to all orders in 5 — d [Til ]. Thus, we expect these predictions to be reliable 
down to d = 2, without the necessity of Borel resummation 19]. These novel critical properties are largely confirmed 
in extensive simulation studies [2l[. Despite lingering controversies associated with claims to the contrary [22], no other 
field theoretic description is free of deficiencies at the basic level of symmetries [23j . 

Most of the surprising - and poorly understood - phenomena appear for T < T c . Simulations showed that the 
ordered state is similar to the one in the Ising lattice gas: full phase separation, coexistence of a high-density region 
(strip) with a low-density one, interfaces aligned with the drive. Beyond these gross features in KLS, none are Ising- 
like and few can be predicted. Focussing on the steady state first, the most prominent feature in a phase segregated 
system is the interface. For d = 2 systems in equilibrium, it is always "rough," i.e., it behaves like a random walk, 
with a width w that scales as L p , where p = 1/2. In KLS, simulations revealed that, especially if the drive is large 
(E J), p is consistent with zero[24|. i.e., the interface is "smooth." Since interfaces in equilibrium systems can make 
transitions (the roughening transition) from being rough to smooth, a natural question is whether similar transitions 
exist for the KLS interface. Such an issue has never been probed systematically. Meanwhile, the roughening transition 
in equilibrium is associated with a singularity in the surface tension (i.e., interfacial free energy) as function of 9, the 
angle the normal of the interface. Whether a similar singularity is present for the KLS interface motivated a series 



FIG. 3: A typical configuration in a 100 x 200 system with open boundaries, driven at E — 2 J, with T ~ Q.lTo- The 
top/bottom row is filled/emptied at the end of Monte Carlo Step. 



of Monte Carlo studies[25| of the driven lattice gas with shifted periodic boundary conditions (SPBC), a standard 
technique for inducing interfaces with various normals. Fig 1(a) illustrates how "slanted" interfaces appear when 
a shift of 5 is imposed on a 100 x 100 lattice. Though there is no well-defined free energy for a system out-of- 
cquilibrium, the internal energy (u) can be easily measured and a singularity in 9 will also appear in u(9). The 
results of these studies led to the next set of surprises provided by the KLS model. First, not only is u (9) singular 
{dgu (0) discontinuous), it is the bulk energy density that is singular (in contrast to the Ising model with SPBC, where 
the bulk u is independent of 9). Further, as the shift increases, the single "slanted" strip breaks up into multiple 
strips, as illustrated in Fig 1(b)! Note that the "multi-strip" configuration is actually a single strip, with multiple 
winding around the torus. Finally, as the shift is further increased, the system makes a series of transitions where the 
winding decreases one by one ("N strips" merging into "N — 1 strips")! In other words, there appears to be a series of 
transitions in the topology of the steady state. Though details remain to be investigated systematically, many aspects 
of these transitions have been explored (through simulations of relatively small systems: 72 x 36) [2(|. This effort also 
raised further questions, as more complex phenomena emerged. For example, an attempt was made at "catching" the 
system at "the critical angle" where the first splitting occurs. Illustrated in Fig 2, "icicles" (long triangular domains) 
appear on one of the interfaces. They are "dynamic," continuously growing and shrinking, so that the system suffers 
anomalously large fluctuations. From these explorations, we learn that seemingly trivial modifications of the original 
KLS model lead to highly complex and unexpected phenomena. Due to space limitations, we only list a few others 
here: 

• Anomalous correlations in interfaces in both KLS and the RDLG[27] 

• Steady states with "icicles" in KLS with open boundary conditions (illustrated in Fig. 3)[29| 

• "Inverted icicles" during coarsening process and failures of the continuum theory [30l] 

• Variety of pattern formation and successes of the continuum theory (3~H 

Most of these phenomena are far from being well understood. For example, the aspect ratio of the "icicle" pattern 
seems to be controlled by the microscopic parameters (J,E,T), but remains to be predicted. 



III. CONCLUDING REMARKS 



In this article, we presented a very brief summary of the surprises provided by the original KLS model, i.e., an Ising 
lattice gas in d = 2 with uniform and isotropic attractive interactions. Thanks to its simplicity, simulation studies 
were plentiful and contributed much to the excitement associated with novel phenomena. Despite its simplicity, 
however, little is known analytically, not even in d = 1 [Hj]. Nevertheless, we have learned a great deal from it, from 
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specific issues such as generic long range correlations (induced by a conservation law) to a range of general properties 
associated with NESS. Following is a short list of the latter, (i) Negative responses should not cause a priori alarm, 
but should be investigated, (ii) Current loops of probability, mass, energy, etc. - whether local or global - can be 
expected and carry valuable information on the system, (iii) Familiar routes of the thermodynamic limit are unlikely 
to be reliable, while the intuition that provided successful coarse-grained continuum descriptions may lead us astray. 
Thus, more dependable techniques should be developed to arrive at macroscopic properties and mesoscopic theories. 
The overall lesson seems to be: Expect the unexpected, whenever one encounters a new NESS, no matter how trivially 
it appears to be related to known systems. 

Although there has been only limited progress on the original KLS model, especially over the last decade, it has 
spawned considerable activity on several related fronts. These involve both extensions and simplifications of the 
original system, the subject of brief notes in the remaining paragraphs. 

Extensions involve anisotropic jump rates[33j], anisotropic interactions [34j . quenched impurities [35|. multispecies [36jj . 
multi-layers [37j . mixtures of dynamics [38j], to name just a few. Remarkably absent are more studies of systems in 
d = 3 [39], in which new phenomena (e.g., shapes of "icicles") can be expected. Not surprisingly, since these models 
are more complex than KLS, even less is known analytically (except the fast rate limit[33]). Nonetheless, through 
computer simulations, these extensions provided many more surprises, especially when the modifications are so minor 
that no novel behavior was anticipacted! Such discoveries further challenge our basic understanding of NESS: How 
unpredictably complex phenomena emerge from incredibly simple dynamic rules [40j. 

For models simpler than KLS, on the other hand, enormous advances on the theoretical front took place. One 
outstanding case is a lattice gas with no attractive interparticle interaction, i.e., a system of biasecLrandom walkers 
with on-site exclusion only. The stationary distribution becomes trivially flat for a system with PBC[4l|, though many 
interesting dynamical properties are present With open boundary conditions, even the stationary distributions 
are non-trivial, with few studies for systems in two or more dimensions. If we simplify further and consider one- 
dimensional lattices (with open boundaries), we find a wealth of analytic results. Known as the asymmetric exclusion 
process (ASEP) and first introduced in 1970 its exact stationary state was found (43l|. showing three non- trivial 



phases as well as unusual dynamics 44 1 . Also clarified is its relationship with other exactly solvable non-equilibrium 
systems, e.g., the zero range process 45j. Furthermore, generalizations of ASEP have been exploited to model physical 
processes such as protein synthesis (since 19 68 1461 H and vehicular traffic (47|. Enjoying considerable attention, it 
is the focus of several comprehensive reviews [48]. Of course, one-dimensional chains cannot support many of the 

interesting features discovered in the KLS, e.g., anisotropic correlations, discontinuity singularities in S (k\, and 

"icicles." Nevertheless, we should celebrate these contributions as giant strides towards our understanding of systems 
driven far from equilibrium. 

To conclude, we remain hopeful that, before long, another Onsager will find an analytic solution to this amazingly 
rich, yet simple model, thereby shedding light on the secrets of NESS in general. Furthermore, our belief is that, 
like the Ising model, it will disperse its fruits far afield, beyond non-equilibrium statistical mechanics to, e.g., graph 
theory, quantum field theory, bioscience, neuroscience, sociophysics and econophysics. 
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